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Abstract 

The large horizontal extent, location in the cold upper troposphere, and ice 
composition make cirrus clouds important modulators of the earth’s radiation budget 
and climate. Cirrus cloud microphysical properties are difficult to measure and model 
because they are inhomogeneous in nature and their ice crystal size distribution and 
habit are not well characterized. Accurate retrievals of cloud properties are crucial for 
improving the representation of cloud scale processes in large-scale models and for 
accurately predicting the earth’s future climate. A number of passive and active remote 
sensing retrieval algorithms exist for estimating the microphysical properties of upper 
tropospheric clouds. We believe significant progress has been made in the evolution of 
these retrieval algorithms in the last decade; however, there is room for improvement. 
Members of the Atmospheric Radiation Measurement program (ARM) Cloud Properties 
Working Group are involved in an intercomparison of optical depth (x), ice water path, 
and characteristic particle size in ice clouds retrieved using ground-based instruments. 
The goals of this intercomparison are to evaluate the accuracy of state-of-the-art 
algorithms, quantify the uncertainties, and make recommendations for improvement. 

Currently, there are significant discrepancies among the algorithms for ice clouds with 
very small (x<0.3) and large (x>1) optical depths. The good news is that for thin cirrus 
(0.3<t<1 ) the algorithms tend to converge. In this first stage of the intercomparison, we 
present results from a representative case study, compare the retrieved cloud 
properties with aircraft and satellite measurements, and perform a radiative closure 
experiment to begin gauging the accuracy of these retrieval algorithms. 



1. Introduction 


Upper tropospheric ice clouds are important modulators of the earth’s climate, cover 
20% of the globe at any given time (Liou 1986), and occur -43% of the time in long-term 
satellite datasets (Wylie and Menzel 1999). Ice clouds, such as cirrus, tend to reflect 
less incoming solar radiation and absorb more infrared radiation than water clouds, 
which are typically optically thicker and occur at a lower altitude than ice clouds. 

Tropical cirrus clouds and convective anvils near the Tropical Tropopause Layer (TTL) 
may play an important role in stratospheric-tropospheric water vapor exchange and 
dehydration of air in the TTL (Rosenfield etal. 1998; Sherwood 1999; Hartmann etal. 
2001; Holton and Gettelman 2001; Jensen and Pfister 2004). Accurate cloud property 
retrievals are important for understanding the radiative feedback of high clouds, and 
parameterization development for global models. 

One of the key uncertainties in climate model simulations is the feedback of upper 
tropospheric clouds on the earth’s radiation budget. The goals of the Global Energy and 
Water Cycle Experiment (GEWEX) Cloud System Study (GCSS) involve bringing 
together members of the observational and modeling community to “facilitate the 
development and testing of improved cloud parameterizations for climate and numerical 
weather prediction models” (Randall et al. 2003). In particular, the GCSS Working 
Group 2 (WG2; http://eos913c.gsfc.nasa.gov/gcss_wg2/) focuses on cirrus clouds. 

Some of the goals of WG2 include determining the level of microphysical complexity 
required for adequate treatment of cirrus clouds in large-scale models and what degree 
of complexity is required for the treatment of ice clouds in remote sensing applications. 



Clearly there is a need by the modeling community to understand the uncertainty and 
validity of the measurements that are being used to develop cloud parameterizations. 

Radiative forcing is used extensively in the Intergovernmental Panel on Climate 
Change Third Assessment Report (IPCC 2001 ) to determine our level of understanding 
concerning the effects of aerosols, clouds, and greenhouse gases on the earth’s 
radiation budget. A key factor in understanding the impact of clouds on the radiation 
budget is determining the cloud radiative forcing (CRF). To calculate the CRF, it is 
essential to have accurate estimates of both clear and cloudy sky fluxes at the surface. 
Clear sky shortwave fluxes can be computed to within 10 W rrf 2 of measured fluxes if 
the appropriate inputs (i.e. aerosol properties, surface albedo, water vapor etc.) are 
used in the model (Ackerman et al. 2003; Michalsky et al 2005). Model clear sky 
longwave fluxes agree with measurements to within ±2 W m' 2 if proper representation of 
the water vapor continuum is included in the model (Marty et al. 2003; Turner et al. 
2004). Modeling cloudy sky fluxes is a more difficult problem because it requires 
knowledge about the cloud optical thickness and scattering properties of the 
hydrometeors that constitute the cloud, as well as the fractional sky cover and the 
extent of cloud inhomogeneity. For ice clouds, there is the added uncertainty concerning 
the ice crystal habit (i.e., the morphology of the ice crystals), which strongly affects both 
the scattering of solar energy and the absorption of infrared energy. The radiative 
properties (i.e. optical depth, phase function, and single scatter albedo) and the 
microphysical properties (i.e. hydrometeor size; ice crystal shape, and ice / water 
content) are critical for estimating the cloud radiative forcing, which is an important tool 



for understanding the effect of clouds on the radiation budget and assessing the 
representation of clouds in climate models. 

For over 10 years, the Department of Energy’s (DOE) Atmospheric Radiation 
Measurement (ARM) program has monitored the atmospheric state with its primary foci 
on understanding the interaction of clouds and radiation and using this knowledge to 
improve the parameterization of clouds in GCMs (Ackerman and Stokes, 2003). The 
goal of the ARM Cloud Properties Working Group (CPWG) is to develop and implement 
algorithms that characterize the physical state of the cloudy atmosphere, including cloud 
occurrence, cloud condensed water amount, and cloud optical properties for all sky 
conditions. For example, members of the CPWG have developed a complex algorithm 
for detecting cloud boundaries using a combination of radar, lidar, and ceilometer 
measurements (Clothiaux et al. 1998). A similar project called Microbase is currently 
underway to develop a continuous baseline cloud microphysical properties product for 
water, ice, and mixed phase clouds using ARM measurements. Currently, a subgroup of 
the CPWG is focusing on the retrieval of microphysical properties from ice clouds. This 
group is actively comparing various remote sensing retrieval algorithms. These 
algorithms use some combination of radar, lidar, and/or infrared (IR) radiance 
measurements and are divided into several different classes. Eventually, the CPWG will 
recommend a suite of algorithms for implementation into microbase. It is important that 
the recommended algorithms be able to span the entire dynamic range of ice clouds 
expected at a given site, and thus climatologies are being used to provide guidance on 
the expected range of the microphysical properties (e.g., Sassen and Comstock 2001 
for the ARM Southern Great Plains site in Oklahoma). 



Our goals in this overview are: 


• To introduce the basic principles of each class of retrieval algorithm (see Table 
1 for a summary of algorithms). 

• Present a case study examining the ability of these state-of-the-art retrievals to 
retrieve cloud properties. 

• To discuss the challenges and possible avenues for evaluating the skill with 
which these algorithms can retrieve cloud properties. 

2. The Retrieval Algorithms 

There are a wide variety of different retrieval algorithms that are used to retrieve cirrus 
microphysical properties. These algorithms differ in their complexity, the instrument 
data used, and in their assumptions; however, they can generally be separated into 
distinct classes. 

2.1 Regression relationships 

Empirical regression relationships are the simplest retrievals and have been 
developed based on a combination of in situ and ground based measurements. These 
regressions generally have the form IWC=aZ b , where IWC is the ice water content, Z is 
the observed radar reflectivity (typically from a cloud radar with a 3 or 8 mm 
wavelength), and a and b are regression coefficients that are commonly available in the 
literature (Liao and Sassen 1994; Atlas et al. 1995; Liu and Illingworth 2000; Matrosov 
et al. 2003). The primary benefit of using regression techniques is their simplicity. 
However, the weakness of this technique is that these relationships have a strong 
temperature and particle size dependence (Atlas et al. 1995; Liu and Illingworth 2000) 



that cause differences in the derived a and b coefficients, which increases the 
uncertainty in the retrieved IWC. 

2.2 Spectral infrared algorithms 

Passive IR and visible measurements have been widely used to retrieve cloud 
properties from satellite (i.e. King et al. 1992; Wielicki et al. 1996; Minnis et al. 1998) 
and ground based instruments (i.e. Min and Harrison 1996; Barnard and Long 2004; 
Marshak et al. 2004). In recent years, algorithms have been developed that utilize high 
spectral resolution measurements in the infrared spectrum by the Atmospheric Emitted 
Radiance Interferometer (AERI) to retrieve cloud properties at the surface (DeSlover et 
al. 1999; Mitchell etal. 2002; Turner 2005). The infrared spectrum is relatively 
transparent to gaseous absorption and emission; however absorption/emission by water 
vapor contributes significantly to the measured infrared signal at the surface. The 
advantage of using high spectral resolution measurements is that we can utilize 
“microwindows” that lie between absorption lines in the IR spectrum. This minimizes the 
contribution of water vapor and other gases to the measured radiance. Nonetheless, it 
is crucial to incorporate an accurate radiative transfer model (such as the Line-by-Line 
Radiative Transfer Model; Clough and lacono 1995), as well as an accurate water vapor 
continuum absorption model, and temperature and humidity profiles, into spectral IR 
algorithms. Infrared retrieval algorithms are limited as the IR optical depth approaches 
6-8 due to saturation in the IR signal. 

2.3 Lidar/Radar and infrared radiometer algorithms 

As the use of active remote sensors in cloud studies matured in the 1970’s-1990’s 

researchers began to focus on the development of combined remote sensor 



microphysical retrievals. One of the original algorithms combined a 694 nm lidar with 
10-12 pm radiometric observations to retrieve layer visible optical depth (x v ) and IR 
emittance (s) in small optical depth clouds and is commonly referred to as the LIRAD 
method (Platt 1973; Platt and Dilley 1981; Comstock and Sassen 2001). The LIRAD 
method relates the integrated backscatter coefficient measured by the lidar to the IR 
absorption optical depth (x a ), allowing x a to be retrieved through an iterative procedure. 
In addition to the LIRAD method, IR radiance measurements have also been combined 
with radar reflectivity measurements (i.e. 35 and 94 GHz frequency radar) to retrieve 
layer integrated microphysical properties such as particle size and IWC (Matrosov et al. 
1992; Mace et al. 1998). In recent years, the reflectivity- 1 R (ZIR hereafter) technique 
has been expanded to retrieve vertical profiles of IWC and particle size, exploiting the 
profiling capabilities of the active remote sensors (Matrosov 1999). 

As with the spectral infrared methods, these combined techniques require that the 
water vapor absorption be removed from the measured IR radiance, and therefore 
exhibit the same upper limit in retrieved optical depth due to saturation. In addition to 
this limitation, algorithms that utilize lidar are restricted to x v <3 due to the attenuation 
limiting nature of visible wavelength lidar in dense clouds. 

2.4 Lidar-radar algorithms 

Lidar-radar (LR) algorithms combine lidar backscatter or extinction coefficient profiles 
with cloud radar reflectivity profiles to retrieve particle size, IWC, and optical 
depth (Intrieri et al. 1993; Donovan and van Lammeren 2001 ; Wang and Sassen 2002). 
The advantages of lidar-radar algorithms are two-fold. First, since lidars and radars 
operate at different wavelengths they are sensitive to different size scatterers. For 



example, scattering at microwave radar wavelengths is dominated by larger particles. 
Radars typically do not detect small particles unless large concentrations are present. 
Radars are therefore unable to detect optically thin cloud layers and the uppermost 
portion of cirrus clouds where ice nucleation produces small ice crystals. Lidar 
wavelengths (typically ultraviolet, visible, and infrared wavelengths are used in cloud 
remote sensing) are sensitive to the small particles. However, attenuation of the lidar 
beam limits the detection of cloud top when optically thick clouds are present. The 
differences in the sensitivity of lidar and radar to different size particles can be used to 
our advantage to retrieve particles sizes (i.e. Donovan and van Lammeren 2001). The 
second advantage of lidar-radar algorithms is they provide high vertical and temporal 
resolution profiles of cloud microphysical properties, which makes it possible to compute 
radiative heating/cooling rates in the atmosphere (this is true for any algorithm that 
provides vertical profiles of cloud microphysical properties). One disadvantage of LR 
algorithms is that they are typically applied only in regions where both the lidar and 
radar detect cloud. 

2.5 Radar reflectivity-Doppler velocity algorithms 

Radar reflectivity-Doppler velocity (ZV) algorithms rely solely on Doppler radar 

measurements to retrieve vertical profiles of IWC and particle size (e.g. Matrosov et al. 
2002; Mace et al. 2002). The advantage of this technique is that the algorithm is not 
limited by either lidar attenuation or IR saturation. This makes ZV algorithms 
advantageous for retrieving cloud properties in multi-layered cloud scenes (i.e. cirrus 
above low level stratus) and optically thick clouds (x v >5). The ZV algorithm relies on 
empirical relationships that relate the fall velocity (v t ) of ice crystals with the particle size 



(D) (e.g., v t =AD B ), which are typically derived from aircraft in situ particle size 
distribution measurements or model simulations. However, prior to applying this type of 
retrieval, the contribution of the ice crystal fall speed to the measured mean Doppler 
velocity must be distinguished from large scale mesoscale motions and cloud 
turbulence motions. As with the LR algorithms, Z V algorithms are also limited by the 
ability of the radar to detect clouds that are below the sensitivity level of the radar. 

3.0 Case study comparison 

Ideally, a case study to intercompare ice cloud retrieval algorithms would involve a 
single layer, horizontally homogeneous cloud with complete overcast skies. Given the 
inherent inhomogeneity of cirrus clouds, the ideal case does not exist. However, we are 
able to isolate single layer cases with relatively uniform cloud thickness. Since the 
algorithms included in this study all involve vertically pointing, narrow field-of-view 
(FOV) instruments, differences in retrieved cloud properties are not generally caused by 
the three-dimensional (3D) nature of the clouds, but rather by the instrument capabilities 
and retrieval assumptions. For example, we do not include retrievals that use 
hemispheric instruments, which may rely on diffuse measurements of the radiative field 
to retrieve cloud properties. 

Based on the above criteria, we have chosen a case observed on 9 March 2000 at 
the ARM Southern Great Plains (SGP) Climate Research Facility to illustrate the 
differences in each algorithm class. This case occurred during the 2000 Cloud Intensive 
Observing Period (IOP) sponsored by the DOE ARM program, and therefore includes 
accompanying measurements that are not normally available at the ARM sites, such as 



aircraft in situ and scanning radar measurements (Mace et al. 2006). We will use some 
of these auxiliary measurements in our discussion of retrieval validation. 

The cirrus cloud observed on 9 March 2000 formed as a weak upper level disturbance 
propagated over the SGP region in a strong southwesterly flow. The initial cloud 
formation occurred as the weak disturbance passed over the mountains of central New 
Mexico during the local morning of 9 March. The clouds thickened into a series of 
bands oriented along the wind as the disturbance moved northeastward. Whole sky 
imagery (Fig. 1 ) reveals that the optically thin cirrus drifting overhead is very 
inhomogeneous with a cloud fraction much less than 1 for most of the time. During the 
2000 Cloud IOP, the University of North Dakota (UND) Citation aircraft flew numerous 
flight patterns in cirrus with overpasses of the SGP site. Flight patterns include “figure 
eights”, and Eulerian and Lagrangian spirals. The Citation housed a Cloud Particle 
Imager (CPI, Lawson et al. 2001 ), which reveals that the predominant particle shape for 
this cirrus is bullet rosettes (Fig. 1, Heymsfield et al. 2002). 

3.1 Retrieval Intercomparison 

Vertically pointing millimeter cloud radar (MMCR) and Micropulse Lidar (MPL) 
measurements illustrate the evolution of the cirrus cloud as it passes over the ARM 
SGP (Fig. 2). The visible optical depth varied by 2-3 orders of magnitude over the 3.5 
hour time period, which is typical for midlatitude synoptically generated cirrus clouds 
that are initially optically thin (x v <0.3) and tend to increase in optical thickness as the 
cloud system passes overhead. While this range in x v is large, it allows us to understand 
the strengths and limitations of each retrieval type. The results from several algorithms 
converge or diverge depending on the optical depth range. 



The time-height images of radar reflectivity and lidar backscatter demonstrate the 
strengths and weaknesses of these two instruments. For example, the optically thin 
cloud detected by the MPL between 9 and 10 km from 2200-2230 UTC is only partially 
detected by the MMCR. On the other hand, it is evident that the MPL is often 
attenuation limited (i.e. 2100-2130) and reports a much lower cloud top height than the 
MMCR. This discrepancy in cloud heights measured by radar and lidar has been 
demonstrated previously (i.e. Intrieri et al. 1995; Comstock et al. 2002), but is 
emphasized here in the context of retrieval algorithms. 

Optically Thin Clouds (x<0.3) 

For optically thin clouds (1900-1915; 2200-2230 UTC), it is clear that the retrievals 
diverge by 1-2 orders of magnitude in x and up to a factor of 20 in IWP (Figs. 3 and 4). 
The Z V algorithms tend to retrieve much smaller x and IWP than algorithms that include 
both radar and lidar (LR), or use lidar only (Raman and COM-Lidar). The AERI and ZIR 
algorithms coincide with the lidar-only x v relatively well, although the AERI-only 
algorithms appear to have a minimum detectability of x v ~0.1 . Similar trends are seen in 
the IWP retrievals; however the AERI only algorithms demonstrate increased scatter in 
IWP as compared with the x v retrievals. 

Optically Thicker Clouds (x v >0.3) 

When referring to mid and upper tropospheric ice clouds, the term “optically thick” 
refers to those clouds that have a x v between ~0.3 and 10.0. As compared with clouds 
such as deep convection, these clouds are not considered optically thick. However, 
since the range of x v observed in cirrus and altostratus clouds varies by 4 orders of 
magnitude, we will use this terminology to distinguish thin and thick ice clouds. The 



majority of the cloud observed during the 9 March 2000 case falls into this “optically 
thick” category. 


As with the optically thin clouds, the retrievals exhibit a large spread in both IWP and 
t v (Figs. 3 and 4). Upon closer inspection, some trends are seen. The algorithms that 
use the lidar (lidar only, LR) and those that use IR measurements (ZIR and AERI) tend 
to have similar optical depths during the 2100-2145 time period. Although these 
algorithms appear to be in good agreement, inspection of the lidar and radar images 
indicate that during this time period, the lidar is attenuation limited in the optically 
thickest portion of the cloud. Therefore, the lidar-based algorithms are biased low 
because of lidar attenuation. Note that the two Z V algorithms have a large spread in t v 
during this time period as well. This emphasizes that although the retrieval techniques 
are fundamentally the similar, the retrieval assumptions introduce uncertainty in the 
retrievals. During this same time period, the wide range in IWP for all retrievals also 
emphasizes the increased uncertainty during periods when the cloud depth is largest. 

For T v and IWP in the 2000-2100 UTC time period, all retrieval algorithms tend to 
converge more closely. This makes sense, since the limitations for each technique (i.e. 
IR saturation, inability to detect cloud etc.) is not an issue for this optical depth range 
(tv~0.3-1.0) 


4.0 The Challenges of Retrieval Validation 

Since one of the goals of this intercomparison project is to recommend an algorithm 

or suite of algorithms to the ARM program for operational retrievals of ice cloud 
microphysical properties, it is important to discuss methods for verifying the results. 
There are a number of challenges when attempting to evaluate retrieval algorithm 



performance. Ideally, the radiance/flux closure exercise should not use the same 
instrument or wavelength that is used in the retrievals. Here, we explore comparisons 
with auxiliary, independent measurements, as well as radiative closure experiments to 
evaluate retrieval performance. 

4.1 Comparisons with Independent Observations 

On 9 March 2000, the UND Citation aircraft also housed a counterflow virtual impactor 

(CVI; Twohy et al. 1997). We compare IWP derived from the CVI with the range of IWP 
retrieved using the ground-based remote sensors (Fig. 5). The mean CVI IWP is 
generally larger than the ground-based retrieved IWP; however the standard deviation 
(vertical bars) overlap with the min/max envelop of the retrieved quantities. 

Some of the challenges that arise when comparing in situ measurements with ground- 
based retrievals include size of the sample volume, particle breakup, and instrument 
sensitivities or limitations. For example, the CVI collects cloud particles at a rate of 
-0.15 m 3 min' 1 , whereas the SGP MMCR and MPL have sample volumes on the order 
of -10 4 m 3 and -10 3 m 3 , respectively at -10 km above ground level. Additionally, the 
uncertainty in collocating the in situ observations in time and space with the remote 
sensing retrievals is considerable. Despite this large discrepancy in sample volume, the 
agreement between the CVI probe and the ground-based retrievals is usually within a 
factor of two. 

In addition to in situ measurements, we can also compare with geostationary satellite 
(GOES) observations. In Fig. 5, we compare the ground-based retrievals of IWP and x 
with the Visible Infrared Solar Split Window Technique (VISST), which uses solar 
reflectance and IR brightness temperature to retrieve cloud properties for each pixel 



(Minnis et al . , 1995, 1998, 2004). The VISST retrievals of IWP are in general agreement 
with the ground-based observations during the thicker cloud regions, but tend to 
overestimate the IWP when the clouds are optically thin. This result is similar for the 
optical depth results. As with the in situ probes, there is a large discrepancy between 
the pixel area of the GOES observation and the area of the remote sensor. In this case, 
the VISST retrieval is for a 0.5x0. 5° area (or -2300 km 2 footprint) vs. the MMCR and 
MPL footprints of -850 m 2 and -450 m 2 at 10 km, respectively. Sample volume and 
area are one of the primary challenges when comparing measurements from different 
platforms. This especially important when the clouds are inhomogeneous and broken. 

4.2 Radiative Closure Experiments 

Radiative closure is one tool used to evaluate retrieved microphysical properties. The 
basic idea is to insert the retrieved microphysical properties into a detailed radiative 
transfer algorithm, compute either the hemispheric fluxes or radiances, and compare 
these model values with observations. Comparisons can be made at either the surface 
or top-of-atmosphere (TOA). Typically, surface fluxes are compared with shortwave 
pyranometers and TOA fluxes are compared with outgoing longwave radiation 
measured by satellite sensors. 

Flux and radiance calculations depend on the optical depth of the layer and the 
scattering or optical properties of the hydrometeors in that layer (i.e. phase function and 
single-scattering albedo). Therefore, if the algorithm retrieves optical depth and particle 
size, you can choose the single-scattering properties based on a parameterization (i.e. 
Fu and Liou 1993; Ebert and Curry 1992), which generally assume a single particle 
shape. Another approach is to develop a database of single-scattering properties based 



on particle size and shape. In either case, the particle shape is unknown (unless in situ 
measurements of particle habit are available) and must be assumed, introducing 
uncertainty in the radiative closure experiments. 

4.2.1 Flux Closure 

As an example of radiative flux closure at the surface, we examine the 9 March case 
study (Fig. 6) to demonstrate how well the retrieved microphysical properties predict the 
surface shortwave flux. For this demonstration, we use the minimum, maximum, and 
average optical depth as input to the radiative transfer code. During the 2100-2200 UTC 
time period, the range in optical depth encompasses the observed downwelling flux 
from the shortwave pyranometer located at the ARM SGP site, with larger optical 
depths providing the closest agreement. As mentioned previously, this time period 
corresponds with the optically thickest portion of the cloud, which would have the most 
horizontally homogeneous, overcast appearance. Optically thin cirrus clouds have a 
fibrous appearance with large amounts of blue sky visible through the cloud layer, while 
optically thicker clouds will have a more overcast appearance (see Fig. 1). Time periods 
when the cloud is more overcast (i.e. larger cloud fraction) will not be as affected by 3D 
radiative effects. The thinner cloud sections (i.e. 1830-1900 UTC) will have much 
smaller cloud fractions, but are subject to 3D effects, which could explain the poor 
agreement during these time periods. 

4.2.2 Radiance Closure 

To demonstrate radiance closure, we compare model radiances with observations of 
downwelling radiance in the 3.8314-3.846 pm microwindow measured by the AERI. This 
midwave-IR microwindow excludes absorption lines but is strongly influenced by 



scattering during the daytime. This approach tests how well the retrieved microphysical 
properties accurately represent both scattering and absorption in the layer. An 
advantage of this approach is that we are using the AERI, which is a narrow field-of- 
view (FOV) instrument that measures a “pencil beam” of radiance rather than the 
hemispherical FOV of the flux radiometers. This reduces the contributions of 3D effects 
and better complements the narrow FOV of the active and passive remote sensors used 
in the retrievals. 

For each retrieval algorithm in Table 1, we directly compare the measured and model 
radiances (Fig. 7). We have divided the results into two groups; algorithms that do not 
utilize IR measurements (Fig. 7a) and those that do (Fig. 7b). The majority of the 
algorithms are biased low as compared with observations. The algorithms that include 
IR measurements appear to be better constrained but almost always biased low. The 
non-IR-based algorithms (LR, EMP, and Z V) exhibit more scatter than the IR 
algorithms, and are generally biased low, except for two algorithms that are often biased 
significantly higher than the observed radiance. The discrepancy between model and 
measured radiances differs on average by -14±64% If we average the radiance 
differences from all of the algorithms according to optical depth ranges, the averages 
are -33±34%, -14±62%, and -2±77% for x v <0.3, 0.3<x v <1 .0, and x v >1 .0, respectively. 

5.0 Further Challenges 

Assumptions of Ice Crystal Shape and Particle Size Distribution 

Clouds containing ice crystals pose an added difficulty to cloud properties retrieval. 

There are currently only limited techniques for determining the particle shape in ice 
clouds; however, some recent research has shown promising results using polarization- 



sensitive instruments (Matrosov et al. 2001, Noel et al. 2002). Each retrieval approach 
must make some assumption concerning ice crystal shape, which can make a 
significant impact on the retrieved microphysical properties, particularly for particle size 
(not shown) and IWP (see Fig. 3 and 4). 

In addition, most algorithms must make some assumption concerning the shape of 
the particle size distribution (PSD; i.e. lognormal, gamma, bimodal etc) and most 
assume a single mode function. There is evidence that the bimodal size distribution may 
be common in many ice clouds, including mid-latitude frontal (Korolev and Isaac 2005) 
and cirrus (Heymsfield and Platt 1984; Arnott et al. 1994), and tropical anvil cirrus 
(McFarquhar and Heymsfield 1996). Since PSDs are exclusively measured by aircraft in 
situ probes, there exists some controversy concerning the contribution of small particles 
to the total size distribution. The controversy primarily encompasses the ability of in situ 
probes to accurately measure particle sizes given the small sample volumes of the 
probes, and the possibility of large particle breakup on probe inlets. This is currently an 
active area of research and a source of debate in the community. 

Since each algorithm makes some assumption concerning the PSD and ice crystal 
shape, discrepancy among algorithms maybe reduced if these assumptions were 
treated consistently between algorithms. 

Uncertainty Estimates 

In this overview, we have presented the retrieved microphysical and radiative 
properties from several fundamentally different approaches. We have not discussed the 
uncertainty associated with each algorithm or the challenge in estimating uncertainty for 
any given algorithm. In recent years, the community has become increasingly aware of 



the importance of developing uncertainty estimates on measured or retrieved cloud 
properties because the applications of these properties include comparisons with model 
simulations, model parameterization development, and for understanding cloud 
processes from the cloud scale to the large scale. Recently, estimation theory (Jawinsky 
1970; Rodgers 2000), such as the general Bayesian approach (i.e. McFarlane et al. 
2002) or the more specific optimal estimation approach (i.e. Austin and Stephens 2001 , 
Stephens et al. 2001; Benedetti et al. 2003; Mitrescu et al. 2005), have been applied to 
inverse retrieval problems related to the atmospheric sciences. The advantage of using 
estimation theory to tackle inverse problems is that it supplies a method for propagating 
errors and uncertainties in the measurements and assumptions in the retrieval 
algorithm. This supplies a more comprehensive and mathematically consistent 
approach to error propagation. Two of the algorithms presented in this overview have 
applied estimation theory to their retrievals (Mace et al. 1998; Turner 2005). Regardless 
of the method chosen, it is clear that a consistent approach to error analysis is needed 
when combining multiple techniques for retrieval of cloud properties from all clouds (i.e. 
water, mixed phase, ice) on a continuous basis, as is the goal of the ARM program. 

Path Forward 

One case is not enough to thoroughly understand our ability to retrieve ice cloud 
microphysical properties. The case study presented here is one of several cases 
examined as part of this intercomparison. Similar trends in the closure experiments 
were observed in those cases as well. Given the vast data archive available through the 
ARM program, comparisons of this kind can be extended to include different seasons, 
different cloud types (i.e. anvil cirrus, wave clouds, synoptic generated cirrus, etc.), and 



different dynamical regimes. This will enable us to develop statistics on how these 
retrievals perform under various conditions. 


Although these comparisons will hopefully lead us to understand how well we can 
retrieve cloud properties, the real question lies in how can we use this knowledge to 
improve the retrieval algorithms themselves. There are several open questions 
concerning ice cloud retrievals that face us today. One is the contribution of small 
particles to the particle size distribution. If small particles are as prevalent as in situ data 
suggest, our approach to remote sensing may be impacted. For example, since the 
radar reflectivity is weighted toward larger particles, do radar approaches bias the 
retrieval of particle size and IWP? On the other hand, the IR and lidar approaches are 
sensitive to other portions of the particle size distribution, which could also introduce 
biases. Given the broad particle size distributions that may exist in cirrus clouds, a 
serious look at multi-sensor, multi-wavelength approaches may assist the improvement 
of cloud property retrievals. 

Another way to understand the strengths and weaknesses of a retrieval algorithm is to 
apply the retrieval to simulated remote sensing data, where a cloud microphysical 
model rovides the atmospheric state and cloud microphysical properties (e.g., Sassen 
et al 2002). However, any inadequacies in the forward model used to simulate the 
remote sensor’s observations, such as consistency of the single scattering properties 
with wavelength, cannot be addressed with a study such as this. 

We have not attempted in this paper to answer the question of which algorithm is 
best. But rather have summarized the challenges that arise in understanding how these 



state-of-the-art algorithms perform, and where the focus should be directed in the 
future. 
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Figure Captions 


Fig. 1 . Images obtained by the Whole Sky Imager (left column) on 9 March 2000 at (a) 
1926, (b) 2032, (c) 2102, (d) 2130, and (e) 2214 UTC. Also shown are images obtained 
by the Cloud Particle Imager during in situ flights aboard the University of North Dakota 
Citation aircraft. 

Fig. 2. Time vs. height display of (a) MMCR reflectivity in dBz and (b) MPL normalized 
backscatter observed on 9 March 2000. 

Fig. 3. Time series of visible optical depth on 9 March 2000 retrieved by (a) lidar-radar 
and reflectivity-Doppler velocity algorithms, (b) empirical, lidaronly, and reflectivity-IR 
algorithms, and (c) spectral infrared algorithms. The “AVG” line represents the average 
T v for all algorithms included in the intercomparison. Note that MAT-EMP is the only 
empirical algorithm that produces x v and that the RAMAN and COM-Lidar algorithms 
retrieve only x v and therefore are not included in the IWP comparisons (Fig. 4). 

Fig. 4. Time series of IWP on 9 March 2000 retrieved by (a) lidar-radar and reflectivity- 
Doppler velocity, (b) empirical and reflectivity-IR, and (c) spectral infrared algorithms. 
The “AVG” line represents the average IWP for all algorithms included in the 
intercomparison. 

Fig. 5. Comparison of ground based, in situ (CVI) and satellite measurements (VISST) 
of (a) IWP and (b) visible optical depth on 9 March 2000. The vertical bars associated 
with the CVI IWP represents the standard deviation of the mean IWP over a 2 min 
interval as the aircraft passed over the SGP CRF. The “AVG” line represents the 
average of all ground based values, and the shaded region represents the min/max 
spread in x v or IWP at that time. 

Fig. 6. Comparison of modeled and measured downwelling shortwave flux at the 
surface on 9 March 2000. The model “avg”, “min”, and “max’ x represent the model flux 
using average, minimum, and maximum visible optical depth as inputs into the radiative 
transfer model. The observed flux is from a hemispherical pyranometer located at the 
SGP CRF. Note that the periods when the observed flux is greater than the model clear 
sky demonstrates how 3D effects can enhance the downward flux due to horizontal 
inhomogeneities in the cloud when the optical depth is relatively small (x v <1.0). 

Fig. 7. Comparison of model and AERI measured radiance on 9 March 2000 at ~3.8 pm 
for (a) algorithms the do not use IR measurements and (b) for algorithms that use IR 
measurements. Note that we do not include MD-AERI results because their algorithm 
uses the 3 pm band to retrieve the cloud microphysical properties. 



Table 1. Algorithms included in the high clouds retrieval intercomparison. 
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Fig. 1 . Images obtained by the Whole Sky Imager (left column) on 9 March 2000 at (a) 
1926, (b) 2032, (c) 2102, (d) 2130, and (e) 2214 UTC. Also shown are images obtained 
by the Cloud Particle Imager during in situ flights aboard the University of North Dakota 
Citation aircraft. 
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Fig. 2. Time vs. height display of (a) MMCR reflectivity in dBz and (b) MPL normalized 
backscatter observed on 9 March 2000. 
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Fig. 3. Time series of visible optical depth on 9 March 2000 retrieved by (a) lidar-radar 
and reflectivity-Doppler velocity algorithms, (b) empirical, lidaronly, and reflectivity-IR 
algorithms, and (c) spectral infrared algorithms. The “AVG” line represents the average 
T v for all algorithms included in the intercomparison. Note that MAT-EMP is the only 
empirical algorithm that produces x v and that the RAMAN and COM-Lidar algorithms 
retrieve only x v and therefore are not included in the IWP comparisons (Fig. 4). 
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Fig. 4. Time series of IWP on 9 March 2000 retrieved by (a) lidar-radar and reflectivity- 
Doppler velocity, (b) empirical and reflectivity-IR, and (c) spectral infrared algorithms. 
The “AVG” line represents the average IWP for all algorithms included in the 
intercomparison. 



Fig. 5. Comparison of ground based, in situ (CVI) and satellite measurements (VISST) 
of (a) IWP and (b) visible optical depth on 9 March 2000. The vertical bars associated 
with the CVI IWP represents the standard deviation of the mean IWP over a 2 min 
interval as the aircraft passed over the SGP CRF. The “AVG” line represents the 
average of all ground based values, and the shaded region represents the min/max 
spread in x v or IWP at that time. 
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Fig. 6. Comparison of modeled and measured downwelling shortwave flux at the 
surface on 9 March 2000. The model “avg”, “min”, and “max’ t represent the model flux 
using average, minimum, and maximum visible optical depth as inputs into the radiative 
transfer model. The observed flux is from a hemispherical pyranometer located at the 
SGP CRF. Note that the periods when the observed flux is greater than the model clear 
sky demonstrates how 3D effects can enhance the downward flux due to horizontal 
inhomogeneities in the cloud when the optical depth is relatively small (x v <1.0). 
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Fig. 7. Comparison of model and AERI measured radiance on 9 March 2000 at ~3.8 pm for (a) 
algorithms the do not use IR measurements and (b) for algorithms that use IR measurements. 
Note that we do not include MD-AERI results because their algorithm uses the 3 pm band to 
retrieve the cloud microphysical properties. 


